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Abstract 

The Renyi distribution ensuring the maximum of a Renyi entropy is investigated for 
a particular case of a power-law Hamiltonian. Both Lagrange parameters, a and (3 
can be excluded. It is found that (3 does not depend on a Renyi parameter q and can 
be expressed in terms of an exponent k of the power-law Hamiltonian and an average 
energy U . The Renyi entropy for the resulted Renyi distribution reaches its maximal 
value at q = 1/(1 + k) that can be considered as the most probable value of q when 
we have no additional information on behaviour of the stochastic process. The Renyi 
distribution for such q becomes a power-law distribution with the exponent — (k + 1) . 
When q = l/(l + K) + e (0<e<l) there appears a horizontal "head" part of the Renyi 
distribution that precedes the power-law part. Such a picture corresponds to observables. 

PACS: 05.10.Gg, 05.20.Gg, 05.40.-a 

1 Introduction 

Numerous examples of power-law distributions (PLD) are well-known in different fields of 
science and human activity [T]. Power laws are considered [2] as one of signatures of complex 
self-organizing systems. They are sometimes called Zipf-Pareto law or fractal distributions. 
We can mention here the Zipf-Pareto law in linguistics [H], economy |3j and in the science of 
sciences Gutenberg- Richter law in geophysics [6J, PLD in critical phenomena [Zj, PLD of 
avalanche sizes in sandpile model for granulated media jB] and fragment masses in the impact 
fragmentation [2 ED], etc. 

Graphically, PLD is presented by a linear graph in a double logarithmic plot of frequency 
or cumulative number as a function of size. It should be noticed here that, in general, double 
logarithmic plots of data from phenomena in nature or economy often exhibit a limited linear 
regime preceded by a near-horizontal "head" part and followed by a tail of significant curvature. 
The latter deviation from a power-law description can be explained by a finite-size effect. 
Really, for instance for the impact fragmentation, extrapolation of the PLD to infinite fragment 
masses would predict masses surpassing a mass of the target. This effect will not be considered 
here. 

Successful derivations of PLD with the head part are based on Renyi or Tsallis distributions 
ensuring maximums of Renyi or Tsallis entropies correspondingly (see, e. g. (TTJ [T2J ) - However, 
some parameters ( q -parameter, Lagrange multiplier (3 ) were left to be indeterminate there. 

Here, a derivation of PLD will be performed on the base of maximum entropy principle 
(MEP) for the Renyi entropy. In the special case that a Hamiltonian of the system is a power- 
law function of a variable of the system the Lagrange multiplier j3 will be excluded at all from 
the Renyi distribution (Sec. 2) and the q -parameter will be determined uniquely with the use 
of expansion of the MEP (Sec. 3). 
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According to the well-known maximum entropy principle (MEP) developed by Jaynes [IH] 
for a Boltzmann-Gibbs statistics an equilibrium distribution of probabilities p = {Pi} must 
provide maximum of the Boltzmann information entropy Sb upon additional conditions of 
normalization Y^iPi — 1 and a fixed average energy U = (H) p = J^iHiPi . 

Then, the distribution {pi} is determined from the extremum of the functional 
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where a and (3q are Lagrange multipliers. Its extremum is ensured by the Gibbs canonical 
distribution, in which /3q = l/k B T and T is the thermodynamic temperature, so there is no 
necessity to invoke the average energy U for exclusion of the Lagrange parameter [3q from the 
Gibbs distribution because of a well-established correspondence between Gibbs thermostatistics 
and classical thermodynamics. On contrary, in applications of MEP to the Renyi entropy, the 
Lagrange parameter f3 may depend on the q -parameter and its physical meaning is not 
evident, so it is necessary to exclude it with the use of the additional condition of MEP related 
to the fixed average energy. 

2 MEP for the Renyi entropy 

If the Renyi entropy 

S R =^-hy^ (2) 

is used instead of the Boltzmann entropy the equilibrium distribution must ensure maximum 
of the functional 
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where a and (3 are Lagrange multipliers. Note that Lr{j>) passes to Lq{p) in the q — > 1 
limit. 

We equate a functional derivative of L R (p) to zero, then 

%M = ^|l- a -^ i = 0. (4) 
opi ±-qJ2jPj 

To exclude the parameter a we can multiply this equation by pi and sum up over i , with 
account of normalization condition Yli Pi — 1 ■ Then we get 

a = — PU (5) 
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and 
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Using once more the condition Y,iPi — 1 we get 
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and, finally, 

Pi=p^ = Zx 1 { 1 - ft^AH^ (7) 
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Zr = E (l - /3^Alf,J " • (8) 

This distribution satisfies to MEP for the Renyi entropy and may be called the Renyi distri- 
bution. When q — > 1 the distribution {p\ R '} becomes the Gibbs canonical distribution. In 
this limit ft/q — > fto = l/ksT . Such behaviour is not enough for unique determination of ft . 
Really, in general it may be an arbitrary function ft(ft ,q) which becomes fto in the limit 
q - 1 . 

To find an explicit form of ft we return to the additional condition of pre-assigned average 
energy U = J2iHiPi and substitute there the Renyi distribution (7). For definiteness sake, we 
will confine the discussion to the particular case of a power-law dependence of the Hamiltonian 
on a parameter x 

Hi = Cxi (9) 

If the distribution {p^} allows for smoothing over the range much larger an average distance 
Axi = Xi — x i+ i without sufficient loss of information, we can pass from the discrete variable 
Xi to the continuous one x . Then the condition of a fixed average energy becomes 



Z' 1 J™ Cx K [l-f3?—^(Cx K -U)y 1 dx = U, H(x)=Cx K (10) 



or 
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(l- ftU?—^(C u x K -l)) 1 dx, C u = %. (12) 
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Both integrals in these equations may be calculated with the use of a tabulated |Uj integral 

too x^dx i /a\£ r[H]r[A-H] 
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under condition of convergence 

< ^ < A, (A > 1). (14) 
For the integrals in Eqs. (16) and (17) this condition becomes 

1 + K 1 , s 

0< <- . 15 

k 1 — q 

Then, finally, we find from Eqs. (11), (12) with the use of the relation T[l + z] — zT[z) , that 

(3U = - for all q. (16) 

K 

Independence of this relation on q means that it is true, in particular, for the limit case q = 1 
where the Gibbs distribution take a place and therefore 

ft = ft = l/k B T for all q. (17) 



at least for power-law Hamiltonian. 

When H = p 2 /2m (that is, « = 2 ) we get from (16) and (17) that U = \k B T as it 
should be waited for one-dimensional ideal gas. 

Besides, the Lagrange parameter (3 can be eliminated from the Renyi distribution (7) with 
the use of Eq. (16) and we have, alternatively, 
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p R (x\q, k) = Z- 1 U - ( ^-{C u x K - l)j 9 1 , H{x) = Cx K (18) 

or 

pf (q, k) = Z- 1 (l - ^{Cuxt ~ 1)) 9 " , Hi = Cxi (19) 

So, at least for power-law Hamiltonian, the Lagrange multiplier (3 does not depend on the 
Renyi parameter q and coincides with the Gibbs parameter (3q = l/fegT , and, moreover, can 
be excluded at all with the use of the relation (16). 

The problem to be solved for an unique definition of the Renyi distribution is determination 
of a value of the Renyi parameter q . This will be the subject of the next section. 



3 The most probable value of the Renyi parameter 

An excellent example of a physical non-Gibbsian system was pointed by Wilk and Wlodarchuk 
[T5] . They took into consideration fluctuations of both energy and temperature of a minor part 
of a large equilibrium system. This is a radical difference of their approach from the traditional 
Gibbs method in which temperature is a constant characterizing the thermostat. As a result, 
their approach leads [H] to the Renyi distribution with the parameter q expressed via heat 
capacity Cy of the minor subsystem 

Cy — ks 

The approach by Wilk and Wlodarchuk was advanced by Beck and Cohen [d HE] who coined 
it the new term "superstatistics". In the frame of superstatistics, the parameter q is defined 
by physical properties of a system. 

On the other side, there are many stochastic systems for which we have no information 
related to a source of fluctuations. In that cases the parameter q can not be determined with 
the use of the superstatistics. 

Here, a useful extension of MEP is proposed. It consists in looking for a maximum of the 
Renyi or Boltzmann entrpopies in space of the Renyi distributions with different values of q . 

It have appeared that both Sji\p R (x\q, k)] and SB\p R (x\q, «)] attain their maximums at 
boundaries of the the range of possible values of q defined by inequalities (15) (see Fig. 1). 
Moreover, the Boltzmann entropy attains its maximum value at q = 1 , that corresponds to 
the Gibbs distribution. 

On contrary, the Renyi entropy attains its maximum value at the minimal possible value 
of q which satisfy the inequality (15), that is, 

Qmin = Z— t • (20) 

1 + K 

For q < q m i n , the integral (10) diverges and, therefore, the Renyi distribution does not deter- 
mine the average value U = (H) p , that is a violation of the condition of MEP. 



Figure 1: The entropies Sn[p R (x\q, K)]/kB (left) and Sb\p (x\q,K))/kB (right) for power-law 
Hamiltonian with the exponent k within the range q > 1/(1 + k) . 



Thus, it is found that the maximum of the Renyi entropy is realized at q = q m i n and it is 
just the value of the Renyi parameter that should be used for the discussed particular case of 
the power-law Hamiltonian if we have no additional information on behaviour of the stochastic 
process under consideration. 

Substitution of q = q m i n into Eq. (22) leads to 

p „ x -("+Q (21) 

Thus, for q = q m i n the Renyi distribution for a system with the power-law Hamiltonian 
becomes PLD over the whole range of x . 

For a particular case of the impact fragmentation where H ~ m 2 / 3 the power-law distri- 
bution of fragments over their masses m follows from (21) as p{m) ~ m 5 / 3 that coincides 
with results of our previous analysis [THI and experimental observations [9j. 

For another particular case k = 1 PLD is p ~ x 2 . Such form of the Zipf-Pareto law is the 
most useful in social, biological and humanitarian sciences. Just the same exponent of PLD 
was demonstrated [19] in cosmic ray physics for energy spectra of particles from atmospheric 
cascades. 

It is necessary to notice here that inequalities (15) suggest in fact q > q min , that is, 
Q = Qmin + e where e is a positive infinitesimal value. It is clear that e(^C 1) should be a 
finite constant in real physical systems. Accounting for e gives rise to the Renyi distribution 
in the form 



p R (x) 



Z-\C u x)^ K+l ^ l+ ^ \l-e(K + l) 2 (l-C u x- K )} (22) 



For sufficiently great x 's this Renyi distribution passes to PLD where all terms with e can 
be neglected. 

On the other side, for small i < 1 , only the term e{n + l) 2 C u x~ K may be accounted in 
the expression in the square brackets, so we get 

p R (x)\ x<<1 ~(e(K + l) 2 )~^ (23) 

This equation points to the fact that the asymptote to the Renyi distribution for small x's is 
a constant of which value is determined by eCl. 

The picture of the Renyi distribution over the whole range of x is illustrated in the Fig. 2 
for particular cases of e = 10~ 6 , e = 10~ 5 and e = 10~ 4 . 

Now there is no methods for an unique theoretical determination of e , so it may be con- 
sidered as a free parameter. It can be estimated for those experimental data where the head 
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Figure 2: The Renyi distributions (non-normalized) for the power-law Hamiltonian H ~ x K , 
k = 1 (left) and k = 2/3 (right) and different values e = 10~ 6 , 10~ 5 , 10~ 4 from upper to 
below in each graph. 

part preceded PLD is presented. As an example, for the probability distribution of connections 
in WWW network [SH] where the exponent of PLD is equal to —2.5 , the parameter e is 
estimated as ~ 10~ 4 . 

4 Conclusions 

Below, some results obtained in the present effort are summarized briefly. Maximum Entropy 
Principle applied to the Renyi entropy gives rise to a Renyi distribution that depends on the 
Renyi parameter q and two Lagrange multipliers a and (3 . The multiplier a corresponds to 
the condition of normalization of the distribution and may be eliminated with ease. The second 
Lagrange multiplier (3 corresponds to the condition of a fixed average energy U = (H) p just 
as p = l/k B T in the Gibbs distribution function. It should be noted here that the connection 
of /3q with the thermodynamic temperature obviates the necessity to eliminate the second 
Lagrange multiplier from the Gibbs distribution. It is not so for the Lagrange multiplier P , at 
least up to a time when the new Renyi thermostatistics will be constructed and P will obtain 
a physical meaning. 

It is shown here that for the particular case of a power-law Hamiltonian Hi = Cx K the 
Lagrange multiplier P does not depend on the Renyi parameter q and coincides with ft . 
Moreover, it can be expressed in terms of U and k and thus excluded at all from the Renyi 
distribution function. 

In the absence of any additional information on a nature of the stochastic process, the q - 
parameter of the corresponding Renyi entropy is determined with the further use of MEP in 
the space of q -dependent Renyi distributions. When applying such MEP to the Boltzmann 
entropy the maximum is found at q = 1 that corresponds to the Gibbs distribution. Maximum 
of the Renyi entropy is found at q = 1/(1 + At) . The exponent of the power-law distribution for 
such q is — (1 + ac) that agrees with observable data for stochastic systems with the power-law 
Hamiltonians. 

It should be noticed that all above estimations of the parameters of the Renyi distribution 
(7) and the exponent of PLD are true as well for the escort version of the Tsallis' distribution 



[12] 



Pi 



(Tb) 



Z^(l-^(l-g')A^)w 



(24) 



because of both distributions are identical if q' = 1/q . Really in this case 

1-?' = ^, t^ = —, (25) 

q 1 — q q — 1 

and (3* is determined by the same second additional condition of MEP as well as (3 . 
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